Information processing apparatus, information processing method, program, and recording medium

ABSTRACT

An information processing apparatus includes reproduction control means for controlling reproduction of a first parameter in order to reproduce an edit applied to a first image, generation means for generating a second parameter from a plurality of first parameters reproduced by the reproduction control means, and edit means for editing the first image based on the second parameter generated by the generation means, and generating a second image.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an information processing apparatus,information processing method, a program, and a recording medium, and inparticular to an information processing apparatus, informationprocessing method, a program, and a recording medium, which can moresimplify editing of an image or the like.

2. Description of the Related Art

For example, in a video camera, an captured image (image data) is codedby, for example, a DV (Digital Video) system or an MPEG (Moving PictureExperts Group) system, and stored on recording media, such as a tape anda disk.

Further, a zoom function is typically provided for the video camera.According to the zoom function, it is possible to change an angle ofview (angle of view showing image within range) (magnification) of thecaptured image. In other words, for example, if an user captures animage by performing zoom-in operation, the image of a narrow angle ofview in which an object is closed up (enlarged) can be obtained, and ifthe user captures an image by performing zoom out operation, the imageof a wide angle in which a wide range is shown can be obtained.

A known video camera has been provided with only one image capture meanswhich captures and outputs an image, and therefore, even though thevideo camera can change an angle of view of the image by way of the zoomoperations (zoom-in operation, zoom out operation), it is not possibleto obtain images of different angle of view at the same time.

Accordingly, a video camera is proposed which has two image capturemeans, for example, and can obtain the image of a narrow angle of viewand the image of a wide angle of view at the same time (for example,Japanese Patent Application Publication No. JP 2004-282296).

SUMMARY OF THE INVENTION

In order to edit the image captured with the video camera or the like,linear editing has been mainly used in which, while reproducing originalimage data, operation is carried out to subject the data to varioustypes of processings, and stores the resulting image on anotherrecording medium. Further, when the original image data are of COPYONCE, in the case of such linear editing, those recorded on therecording medium are reproduced but the image further edited can not berecorded.

Further, when one image is subjected to a plurality of editingrespectively, it is difficult to confirm the effect when combination ofthe plurality of editing is performed. For example, by subjecting theedited image to another editing, the effect is confirmed after the twoedits are carried out. If the resulting effect is not a desired one, theoriginal image is subjected to another edit again, and by repeating sucha process, the user continues editing until a desired effect isobtained.

The present invention is made in view of the situation, and it isdesirable to provide an optimal image to an user.

An aspect of embodiments of the present invention provides aninformation processing apparatus which includes reproduction controlmeans for controlling reproduction of a first parameter which is forreproducing an edit to be applied for a first image, generation meansfor generating a second parameter out of a plurality of first parametersreproduced by the reproduction control means, and edit means for editingthe first image based on the second parameter generated by thegeneration means, to generate a second image.

The first parameter may include at least a parameter for extracting apredetermined area from the first image, and the second parameter may bea parameter for extracting an area, including a plurality of areas basedon the plurality of first parameters, from the first image.

The first parameter may include at least a parameter for extracting apredetermined area from the first image, and the second parameter may bea parameter for extracting, from the first image, an area for extractingan image in a predetermined area among a plurality of areas based on theplurality of first parameters, and not extracting an image in otherareas.

The second parameter may be generated by adding the plurality of firstparameters, or by subtracting other parameter from a predeterminedparameter among the plurality of first parameters, by way of thegeneration means.

An aspect of embodiments of the present invention provides aninformation processing method which includes the a step of controllingreproduction of a first parameter for recreating an edit applied for afirst image, a step of generating a second parameter from a plurality offirst reproduced parameters, and a step of editing the first image basedon the generated second parameter, in order to generate a second image.

An aspect of the present invention provides a computer program forcausing a computer to perform processings including a step ofcontrolling reproduction of a first parameter for recreating an editapplied for a first image, a step of generating a second parameter froma plurality of first reproduced parameters, and a step of editing thefirst image based on the generated second parameter, in order togenerate a second image.

An aspect of the present invention provides a recording medium havingrecorded therein a program for causing a computer to perform aprocessings including a step of controlling reproduction of a firstparameter for recreating an edit applied for a first image, a step ofgenerating a second parameter from a plurality of first reproducedparameters, and a step of editing the first image based on the generatedsecond parameter, in order to generate a second image.

In the information processing apparatus and method, the program, and theprogram recorded in the recording medium according to an aspect of thepresent invention, the second parameter is generated from the pluralityof first parameters for recreating the edit applied to the first image,and the first image is edited based on the second parameter.

According to one aspect of the present invention, it becomes possible toeasily confirm the effects of combining the plurality of edits.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing a structure of an embodiment of a system towhich the present invention is applied;

FIG. 2 is a diagram for explaining a file;

FIG. 3 is a diagram showing an example of an internal structure of areproduction apparatus;

FIG. 4 is a drawing for explaining extraction of an image;

FIG. 5 is a flow chart for explaining operation of the reproductionapparatus;

FIG. 6 is a schematic drawing for explaining zooming;

FIG. 7 is a drawing for explaining tracking zoom;

FIG. 8 is an example of the image displayed on a display apparatus;

FIG. 9 is an example of the image displayed on the display apparatus;

FIG. 10 is an example of the image displayed on the display apparatus;

FIG. 11 is an example of the image displayed on the display apparatus;

FIG. 12 is an example of the image displayed on the display apparatus;

FIG. 13 is a diagram for explaining the file;

FIG. 14 is an example of the image displayed on the display apparatus;

FIG. 15 is an example of the image displayed on the display apparatus;

FIG. 16 is an example of the image displayed on the display apparatus;

FIG. 17 is an example of the image displayed on the display apparatus;

FIG. 18 is an example of the image displayed on the display apparatus;

FIG. 19 is an example of the image displayed on the display apparatus;

FIG. 20 is a flow chart for explaining operation of the reproductionapparatus;

FIG. 21 is an example of the image displayed on the display apparatus;

FIG. 22 is an example of the image displayed on the display apparatus;

FIG. 23 is an example of the image displayed on the display apparatus;

FIG. 24 is a flow chart for explaining operation of the reproductionapparatus; and

FIG. 25 is a diagram for explaining a recording medium.

DETAILED DESCRIPTION OF THE EMBODIMENTS

The embodiments of the present invention will be described below.Correspondence relationships between the constituent elements of thepresent invention and the embodiments described in the specification orthe drawings are as follows. This description is for confirming that theembodiments which support the present invention are described in thespecification or the drawings. Therefore, even if there is an embodimentwhich is described in the specification or the drawings but notdescribed herein as the embodiment corresponding to the constituentelements of the present invention, it does not mean that the embodimentdoes not correspond to the constituent elements. On the contrary, evenif an embodiment is described here as corresponding to the constituentelements, it does not mean that the embodiment does not correspond toany constituent element other than the constituent elements.

An aspect of the present invention provides an information processingapparatus (for example, reproduction apparatus 12 in FIG. 3) whichincludes reproduction control means (for example, reproducing parameterprocessing unit 54 in FIG. 3) for controlling reproduction of a firstparameter for recreating an edit applied to a first image, generationmeans for generating a second parameter from a plurality of firstparameters reproduced by the reproduction control means (for example,processing data operation unit 57 in FIG. 3), and edit means (forexample, image extraction unit 52 in FIG. 3) for editing the firstimage, based on the second parameter generated by the generation means,in order to generate a second image.

Below, embodiments of the present invention will be described below withreference to drawings.

FIG. 1 is a diagram showing a structure of an embodiment of a system towhich the present invention is applied. Image data, such as an image(video image) taken by a user, and a television broadcasting program, isrecorded on a recording medium 11. The reproduction apparatus 12reproduces the image data recorded on the recording medium 11. Thereproduced image is supplied to a display apparatus 13 and provided tothe user.

In the embodiments of the present invention, the recording medium 11 maybe any type of medium. The medium may be, for examples, CD-ROM (CompactDisc-Read Only Memory), DVD (Digital Versatile Disc), and the like, orvideotape. Further, in the present embodiment, the description is madeby assuming that the recording medium 11 is a recording medium which canbe detached from and attached to the reproduction apparatus 12 and theimage based on the image data read from the recording medium 11 isreproduced. On the other hand, the present invention also includes anembodiment in which the image data are obtained through a transmissionmedium constituted by internet, or the like, and the image based on theimage data is reproduced.

The reproduction apparatus 12 has a function of reproducing the imagedata recorded on the recording medium 11. The display apparatus 13 isconstituted by CRT (Cathode Ray Tube), LCD (Liquid Crystal Display), andthe like, and displays the image from the reproduction apparatus 12.

Now, the data handled in the system as shown in FIG. 1 will bedescribed. Content data 21 are stored in the recording medium 11. A file22 is stored in the reproduction apparatus 12. An normal image isprovided to the user side only when the content data 21 recorded on therecording medium 11 are reproduced by the reproduction apparatus 12. Ifthe content data 21 recorded on the recording medium 11 and the data inthe file 22 recorded in the reproduction apparatus 12 are reproduced, animage obtained by subjecting the normal image to a certain edit(processing) is provided to the user side.

As shown in FIG. 2, a plurality of reproducing parameters 30-1 to 30-Nare included in the file 22. The reproducing parameters 30-1 to 30-N aredata for subjecting the original image obtained by reproducing thecontent data 21 to the edit carried out by the user, respectively. Thus,in the present embodiment, since the user does not write own edit resultinto the content data 21, in other words, since the user does not editthe content data 21 itself, the original image may be left as it is.

In the following description, the reproducing parameters 30-1 to 30-Nmay be simply referred to as the reproducing parameters 30, when theparameters are not required to be distinguished respectively. The sameapplies to other descriptions.

Further, the user may subject the original image to a plurality of editsseparately. In other words, the user may generate a plurality of files22, the reproducing parameters 30, or processing data 32 with respect tothe original image.

For example, if the content data 21 are edited, the original image islost, and thus the already performed edit is further edited in the caseanother edit is carried out next. However, in the present embodiment,even if the plurality of edits are carried out, the data for recreatingthe edits are saved as different data. Thus, it is possible to confirmthe results of the respective edits separately, and it is also possibleto confirm an effect when the plurality of edit results are combined byway of a process as will be described later.

The reproducing parameter 30 includes a synchronizing feature 31 and theprocessing data 32, as shown in FIG. 2. The description is made byassuming that the synchronizing feature 31 and the processing data 32are included in the reproducing parameter 30, but processing can beperformed as long as the synchronizing feature 31 and the processingdata 32 are associated and stored (if managed in the file 22).Therefore, the synchronizing feature 31 and the processing data 32 arenot required to be included in the reproducing parameter 30.

A synchronizing feature 31-1 and a processing data 32-1 are included inthe reproducing parameter 30-1. Further, a synchronizing feature 31-2, aprocessing datum 32-2, and a processing datum 32-3 are included in thereproducing parameter 30-2. The synchronizing feature 31-N and aprocessing datum 32-M are included in reproducing parameter 30-N.

The synchronizing feature 31 is generated per each field or per eachframe. Here, the description is made by assuming that the synchronizingfeature is generated per each frame.

The synchronizing feature 31 is information indicating which frame ofthe content data 21 the reproducing parameter 30 relates to. Thesynchronizing feature 31 is a feature extracted from a reproduced frame,when the content data 21 are reproduced. As will be described later,when the content data 21 are reproduced, the feature is extracted fromthe reproduced frame, and whether the synchronizing feature 31 match theextracted feature is determined. When it is determined that the featuresmatch, the frame is subjected to the edit as shown by the processingdata 32.

The synchronizing feature 31 is a datum for synchronizing with apredetermined frame of the frames which constitute the contents. Inother words, the synchronizing feature 31 is a datum used whendetermining which frame of the frames constituting the contents is forthe processing data 32.

The synchronizing feature 31-2, the processing datum 32-2, and theprocessing datum 32-3 are included in the reproducing parameter 30-2. Inthis case, two processing data 32-2 and 32-3 are associated with onesynchronizing feature 31-2. In this case, even if the image subjected tothe edit based on the processing datum 32-2 and the image subjected tothe edit based on the processing datum 32-3 are the images from the sameframe, they become different images.

As for the reproducing parameter 30-1, one processing datum 32-1 isassociated with one synchronizing feature 31-1. In such a case, it isshown that one edit is carried out for one frame. As for the reproducingparameter 30-2, two processing data, the processing datum 32-2 andprocessing datum 32-3 are associated with one synchronizing feature31-2. In such a case, it is indicated that two different edits areapplied to one frame.

Thus, one processing datum 32 may be associated with one synchronizingfeature 31, or alternatively the plurality of processing data 32 may beassociated with the feature. A number of the associated processing data32 is equivalent to a number of the edits applied to one frame.

Thus, the reproducing parameter 30 includes the synchronizing feature 31for synchronizing with the frame which constitutes the contents, and theprocessing data 32 for recreating the edit applied to the synchronizedframe.

Since the video image based on one contents datum 21 is constituted by aplurality of frames, the plurality of reproducing parameters 30 aregenerated for one content datum 21. Although it is possible to store theplurality of reproducing parameters 30 as such, it may be easier tomanage them by storing them in files as shown in FIG. 2. Then, one filemay be generated for one content datum 21, for example, as describedabove.

As shown in FIG. 2, the reproducing parameter 30-1 and the reproducingparameter 30-2 are included in the file 22, for example. It is assumedthat this file 22 is a file including the reproducing parameter 30corresponding to the content data 21. A file 22′ (not shown) which isdifferent from the file 22 is a file for a content datum different fromthe file 22.

Next, a structure of the reproduction apparatus 12 which reproduces sucha reproducing parameter 30 together with the content data 21 isdescribed. FIG. 3 is a diagram showing an example of an internalstructure of a reproduction apparatus 12.

The reproduction apparatus 12 includes a record and reproduction unit51, an image extraction unit 52, a signal processing unit 53, areproducing parameter processing unit 54, an operation unit 55, areproducing parameter memory unit 56, a processing data operation unit57, and a file memory unit 58.

For example, the record and reproduction unit 51 reproduces the contentdata 21 from the recording medium 11, and supplies an image to the imageextraction unit 52 in response to operation by the user by means of theoperation unit 55.

In the following description, the image obtained by reproducing thecontent data 21 is referred to as the normal image. The image obtainedby subject the normal image to edit based on the processing data 32 isreferred to as an extraction image. Hereinafter, the description is madewith reference to an edit in which partly enlarged normal image isdisplayed. In other words, the description is made with reference to theedit in which a part of the normal image is extracted, enlarged, anddisplayed.

Returning now to the description with reference to FIG. 3, based on thereproducing parameter 30 supplied from the reproducing parameterprocessing unit 54, the image extraction unit 52 extracts an image ofpartial area from the normal image which is supplied from the record andreproduction unit 51, and outputs the extracted abstract image to thesignal processing unit 53.

In other words, the reproducing parameter 30 (processing data 32included therein) includes information showing a rectangular area on thenormal image, for example, a side length (width) and a vertical length(height) of the rectangular area, and coordinates at a top left point onthe normal image. The image extraction unit 52 specifies, based on thereproducing parameter 30, the rectangular area (hereinafter referred toas extraction window) represented by the information included in theparameter. Then, the image extraction unit 52 extracts the image withinthe extraction window from the normal image as the extraction image, andsupplies the image to the signal processing unit 53.

Based on the reproducing parameter 30 supplied from the reproducingparameter processing unit 54, the signal processing unit 53 subjects theextraction image supplied from the image extraction unit 52 to thesignal processing, and supplies the image to the display apparatus 13(FIG. 1). Thus, the extraction image subjected to the signal processingat the signal processing unit 53 is displayed on the display apparatus13.

The reproducing parameter processing unit 54 supplies the reproducingparameter 30 supplied from the file memory unit 58, to the imageextraction unit 52 and the signal processing unit 53. Further, thereproducing parameter processing unit 54 generates the reproducingparameter 30 in response to the operation by the user by means of theoperation unit 55, and supplies the parameter to the image extractionunit 52 and the signal processing unit 53. Furthermore, the reproducingparameter processing unit 54 supplies the reproducing parameter 30supplied from the file memory unit 58 or the reproducing parameter 30generated in response to the operation of the operation unit 55, to thereproducing parameter memory unit 56 in order to store therein. Further,the reproducing parameter processing unit 54 reads the reproducingparameter 30 stored in the reproducing parameter memory unit 56, so thatthe parameter is supplied and stored in the file memory unit 58.

The reproducing parameter memory unit 56 temporarily stores thereproducing parameter supplied from the reproducing parameter processingunit 54. When reproduction command or, edit command, or the like isissued to the content data 21 (normal image) recorded on the recordingmedium 11, the operation unit 55 is operated by the user and supplies anoperation signal corresponding to the operation, to the record andreproduction unit 51 or the reproducing parameter processing unit 54.

The processing data operation unit 57 performs processes, such asaddition and subtraction between the processing data 32 as will bedescribed later. The newly generated processing data are supplied to thereproducing parameter processing unit 54. The file memory unit 58 storesthe file 22 as shown in FIG. 2.

Although the file memory unit 58 is include in the reproductionapparatus 12 in FIG. 3, the file memory unit 58 may be constituted by arecording medium detachable to the reproduction apparatus 12, and thereproduction apparatus 12 may include a drive where the recording mediumis detached/attached. Thus, since the file memory unit 58 includes therecording medium, the recording medium may be attached/detached to otherreproduction apparatuses to enable reproduction of the file 22 in theother apparatuses.

Next, with reference to FIG. 4, processing of the image extraction unit52 in FIG. 3 is described.

For example, when the operation by the user is an operation to enlargeand display a predetermined image within the normal image, in thereproducing parameter 30 includes the processing data 32 having theinformation indicative of an area corresponding to the extraction imagein the normal image. The area indicated by the processing data 32 areset as the extraction window, as shown in FIG. 4, and an image withinthe extraction window is extracted, from the normal image, as theextraction image, and displayed. By performing such processings, thepredetermined image displayed within the normal image is displayed onthe display apparatus 13 with enlarged state.

When the user performs an edit corresponding to zoom-in, an angle ofview of the normal image obtained by the edit becomes narrow, the areacorresponding to the normal image becomes small in size, as shown by R₁or R₂ in FIG. 4, and the extraction window also becomes small in sizecompared to a size of the normal image.

Thus, since the size of the extraction window is not necessarilyconstant, a number of pixels of the extraction image extracted from thenormal image by using such an extraction window is not necessarilyconstant in the image extraction unit 52.

On the other hand, since the display apparatus 13 displays the image ofa predetermined number of pixels, the image extraction unit 52 isrequired to convert the extraction image extracted from the normal imageto an image of the predetermined number of pixels which may be displayedon the display apparatus 13. As an example of an image conversionprocess of converting the extraction image of a certain number of pixelsto the extraction image of other numbers of pixels, there may be aprocess carried out by interpolating pixels.

Next, with reference to a flow chart of FIG. 5, operation of thereproduction apparatus 12 of FIG. 3 is described. Firstly, basicoperation of the reproduction apparatus 12 is described. Here, it isassumed that the basic operation is carried out when one processingdatum 32-1 is associated with one synchronizing feature 31-1, as with acase of the reproducing parameter 30-1 of FIG. 2.

When the user operates the operation unit 55 and turns on a power supplyof the reproduction apparatus 12, the reproducing parameter processingunit 54 determines, in step S21, whether an operation mode of thereproduction apparatus 12 is a reproduction mode.

Here, as for the operation modes of the reproduction apparatus 12, thereare the reproduction mode in which the image stored on the recordingmedium 11 is reproduced and an edit mode in which the image is edited,for example. The operation mode of the reproduction apparatus 12 can beselected (set up) when the user operates the operation unit 55, forexample.

When it is determined that the operation mode of the reproductionapparatus 12 is the reproduction mode at step S21, the process advancesto step S22 and the processing of the reproduction mode is started.

In the processing of the reproduction mode, the file 22 used forreproducing the image recorded on the recording medium 11 is selected bythe reproducing parameter processing unit 54 at step S22.

Here, as described above, a series of reproducing parameters 30generated for the normal image (content data 21 in this case) areincluded in the file 22. Further, the file 22 is stored in the filememory unit 58. One or more files 22 can be stored in the file memoryunit 58, and the file 22 used for reproduction of the image is selectedfrom the one or more files 22 at step S22.

In other words, for example, the reproducing parameter processing unit54 recognizes a file name of the file 22 stored in the file memory unit58. The file name may be a date and time when the contents data 21 areobtained (recorded on the recording medium 11 by photography, videorecording, etc.), or may be a name given by the user, etc. Furthermore,the reproducing parameter processing unit 54 displays on the displayapparatus 13 a list of the file names stored in the file memory unit 58by controlling the signal processing unit 53, together with a message tourge the user to select any one of them.

When the user operates the operation unit 55 and select one file nameout of the list of the file names displayed on the display apparatus 13,the reproducing parameter processing unit 54 selects the file 22specified by the file name as a file 22 used for reproducing the image,in step S22.

Then, the process moves from step S22 to step S23. By controlling therecord and reproduction unit 51, the reproducing parameter processingunit 54 starts to reproduce the file 22 stored in the file memory unit58 and starts to reproduce the contents data 21 recorded on therecording medium 11. Thus, the content data 21 are reproduced (read)from the recording medium 11, and the contents data 21 are supplied tothe image extraction unit 52 as well as the file 22 (reproducingparameter 30 included in file 22) is supplied from the file memory unit58 to the reproducing parameter processing unit 54.

Here, as described above, the reproducing parameter 30 may exist pereach frame. The reproduction of the normal image is started with theearliest (in terms of time) frame, where the reproducing parameter 30exists, unless particularly specified.

In step S23, the reproducing parameter processing unit 54 starts toreproduce the reproducing parameter 30 included in the file 22. Thus, ifthe reproducing parameter 30 starts to be supplied from the record andreproduction unit 51, the reproducing parameter 30 starts to be suppliedto the image extraction unit 52 and the signal processing unit 53, andthe process advances to step S24.

In step S24, from the normal image supplied from the record andreproduction unit 51, the image extraction unit 52 starts to extract theextraction image based on the reproducing parameter which is suppliedfrom the reproducing parameter processing unit 54.

In other words, the normal image is supplied from the record andreproduction unit 51 to the image extraction unit 52 per a frame basis,for example. Based on assumption that the frame of the normal imagesupplied from the record and reproduction unit 51 is a frame ofinterest, the image extraction unit 52 extracts the extraction imagefrom the frame of interest sequentially, and supplies it to the signalprocessing unit 53.

In particular, among the reproducing parameters 30 supplied from thereproducing parameter processing unit 54, if the reproducing parameter30 with respect to the frame of interest (hereinafter referred to ascorrespondence parameter) exists, the image extraction unit 52 extracts,the image within the extraction window specified by the informationincluded in the correspondence parameter, from the frame of interest asthe extraction image and performs the image conversion process ofchanging the number of pixels to be supplied to the signal processingunit 53, where necessary.

Further, if the correspondence parameter of the frame of interest doesnot exist in the reproducing parameters 30 supplied from the reproducingparameter processing unit 54, the image extraction unit 52 may extractthe extraction image from the frame of interest based on thecorrespondence parameter 22 of the frame nearest to the frame ofinterest of the frames in which the correspondence parameters before theframe of interest exists. Alternatively, since the absence of thecorresponding parameter means that the edit is not performed, the normalimage may be outputted.

After the processing in step S24, the process moves to step S25, and thesignal processing unit 53 starts performing the signal processing on theextraction image (its frame) supplied from the image extraction unit 52,based on the reproducing parameter (correspondence parameter) suppliedfrom the reproducing parameter processing unit 54.

In other words, the signal processing unit 53 subjects the extractionimage supplied from the image extraction unit 52, to the signal processindicated by the information which is included in the reproducingparameter 30 supplied from the reproducing parameter processing unit 54,and supplies it to the display apparatus 13.

As described above, in the process of the reproduction mode, since theextraction image is extracted from the normal image based on thereproducing parameter 30 included in the file 22 and further theextraction image is subjected to the signal process based on thereproducing parameter 30, the image content (stream of image)corresponding to the reproducing parameter 30 of the file 22 isdisplayed on the display apparatus 13.

After the processing in step S25, the process advances to step S26. Thereproducing parameter processing unit 54 determines whether theoperation unit 55 is operated (stop operation) by the user to stop thereproduction. In step S26, if it is determined that the stop operationis not performed, the process returns to step S23 and the similarprocessing is repeated.

When it is determined that the stop operation is performed in step S25,the process advances to step S27. The reproducing parameter processingunit 54 controls the record and reproduction unit 51, the imageextraction unit 52, and the signal processing unit 53, to stop all ofthe processes of reproducing the normal image and the reproducingparameter started at step S23, extracting the extraction image startedat step S24, signal processing subjected to the extraction image at stepS25. Then, the process returns to step S21 and the similar processing isrepeated.

On the other hand, in step S21, when it is determined that the operationmode of the reproduction apparatus 12 is not the reproduction mode, theprocess advances to step S28 and the reproducing parameter processingunit 54 determines whether the operation mode of the reproductionapparatus 12 is the edit mode. In step S28, if it is determined that theoperation mode of the reproduction apparatus 12 is not the edit mode,the process returns to step S21 and the similar processing is repeated.

Further, in step S28, if it is determined that the operation mode of thereproduction apparatus 12 is the edit mode, the process advances to stepS29 and the processing in the edit mode is performed.

In the processing of the edit mode, the record and reproduction unit 51starts to reproduce the content data 21 recorded on the recording medium11 at step S29, whereby, the content data 21 are reproduced (read) fromthe recording medium 11, and the normal image is supplied to the imageextraction unit 52.

Alternatively, in step S29, the reproducing parameter 30 (file 22) (setfor reproduction) used for reproducing the contents data 21 which may bea reference of edit, is selected by the reproducing parameter processingunit 54 as with the case of step S22, for example. Then, the reproducingparameter processing unit 54 starts to reproduce the content data 21 andthe set for reproduction by controlling the record and reproduction unit51 as with the case of step S23, whereby the contents data 21 arereproduced (read) from the recording medium 11, the normal image issupplied to the image extraction unit 52, and the reproducing parameterof the set for reproduction is supplied from the file memory unit 58 tothe reproducing parameter processing unit 54.

The reproducing parameter 30 starts to reproduce the set forreproduction. Thus, as the supply of the reproducing parameter 30 fromthe record and reproduction unit 51 is started, the reproducingparameter processing unit 54 starts the supply of the reproducingparameter 30 to the image extraction unit 52, the signal processing unit53, and the reproducing parameter memory unit 56, and the processadvances to step S30.

The reproduction apparatus 12 reproduces only the contents data 21 andcan provide the normal image. Therefore, the user may reproduce thecontents data 21 recorded on the recording medium 11, and edit thenormal image which is provided in accordance with the reproduction.

Further, by reproducing the reproducing parameter 30 included in thecontent data 21 and the file 22, the reproduction apparatus 12 canprovide the edited normal image to an user. Therefore, the userreproduces the contents data 21 and the reproducing parameter 30, andcan further edit the edited normal image provided in accordance with thereproduction.

As with the processing in step S22, whether the normal image is editedor the edited image is further edited may be determined by causing theuser to select a file name. When the file name is adapted to beselected, a file name for editing the normal image is also displayed.

Here, the description is made with reference to the case where thenormal image is edited.

In step S30, the reproducing parameter processing unit 54 determineswhether the user operates the operation unit 55 to issue the editcommand. In step S30, if where it is determined that the edit command isnot issued, in other words, if it is determined that the user does notoperate the operation unit 55 such that to the edit command is issued,step S31 is skipped and the process advances to step S32.

Further, in step S30, if it is determined that the edit operation isperformed, in other words, if it is determined that the user operatesthe operation unit 55 to issue the edit command, the process advances tostep S31. As the correspondence parameter of the frame of interest ofthe normal image which is the frame of interest when the edit operationis performed, the reproducing parameter processing unit 54 generates areproducing parameter (new reproducing parameter) (hereafter may bereferred to as editing parameter) in accordance with the edit operation,and supplies it to the image extraction unit 52, the signal processingunit 53, and the reproducing parameter memory unit 56.

In this case, therefore, in the image extraction unit 52, the imagewithin the extraction window which is specified by the informationincluded in the editing parameter from the reproducing parameterprocessing unit 54 is extracted from the normal image as the extractionimage. In the signal processing unit 53, the extraction image suppliedfrom the image extraction unit 52 is subjected to the signal processwhich is indicated by the information included in the editing parametersupplied from the reproducing parameter processing unit 54, to besupplied to the display apparatus 13. As a result, the image editedaccording to the edit operation is displayed on the display apparatus13.

Furthermore, the reproducing parameter memory unit 56 stores the editingparameter supplied from the reproducing parameter processing unit 54. Atthis time, the feature is extracted from the frame of interest, and withrelevance to the feature, the editing parameter is generated and stored.In the processing as will be described later, when the editing parameteris stored in the file memory unit 58, the feature is stored as thesynchronizing feature 31, and the parameter generated with respect tothe edit is stored as the processing data 32 with relevance to thesynchronizing feature 31.

When the reproducing parameter 30 with respect to the normal image(contents data 21) to be edited already exists, the synchronizingfeature 31 included in the reproducing parameter 30 is read and storedin the reproducing parameter memory unit 56. Then, in the process ofassociating to the synchronizing feature 31, the parameter regarding thenew edit is associated, and the editing parameter is generated andstored.

In step S31, the editing parameter is supplied to the image extractionunit 52, the signal processing unit 53, and the reproducing parametermemory unit 56, and thereafter the process advances to step S32. Thereproducing parameter processing unit 54 determines whether theoperation unit 55 is operated by the user so that the reproduction maybe stopped (stop operation). If it is determined in the step S32 thatstop operation is not performed, the process returns to step S30 and thesimilar processing is repeated.

Further, in step S32, when it is determined that stop operation isperformed, the process advances to step S33. By controlling the recordand reproduction unit 51, the image extraction unit 52, and the signalprocessing unit 53, the reproducing parameter processing unit 54 stopsall of the processes of reproducing the normal image, extracting theimage, and subjecting the extraction image to the signal processing.

In step S34, the reproducing parameter processing unit 54 determineswhether a parameter set which is a set of the reproducing parametersstored in the reproducing parameter memory unit 56 is newly stored(saved) in the file memory unit 58.

In other words, by controlling the signal processing unit 53, thereproducing parameter processing unit 54 causes the display apparatus 13to display an inquiry message for asking whether the new parameter setis saved. After the user operates the operation unit 55 with respect tothe inquiry message, whether the new parameter set stored in thereproducing parameter memory unit 56 is stored in the file memory unit58 is determined.

In step S34, if it is determined that the new parameter set stored inthe reproducing parameter memory unit 56 is stored in the file memoryunit 58, in other words, if the user operates the operation unit 55 withrespect to the inquiry message so that the new parameter set may bestored, the process advances to step S35. The reproducing parameterprocessing unit 54 reads the new parameter set stored in the reproducingparameter memory unit 56, and stores the new parameter set in the filememory unit 58.

Further, in step S34, if it is determined that the new parameter setstored in the reproducing parameter memory unit 56 is not stored in thefile memory unit 58, in other words, if the user operates the operationunit 55 with respect to the inquiry message so that the new parameterset may not be stored, step S35 is skipped and the process advances tostep S36. The reproducing parameter processing unit 54 deletes(eliminates) the new parameter set stored in the reproducing parametermemory unit 56, the process returns to step S21, and the similarprocessing is repeated.

The new parameter set stored in the file memory unit 58 in theprocessing of the edit mode may be selected as the set for reproduction,and therefore the image content corresponding to the reproducingparameter of the new parameter set can be displayed on the displayapparatus 13.

Further, the processing according to the flow chart of FIG. 5 is ended,when the operation unit 55 is operated by the user so that the powersupply thereof may be turned off.

As described above, as the user performs the edit operation, the editingparameter (new reproducing parameter) is generated in response to theedit operation, and the extraction processing and the signal processingare performed based on the editing parameter. Accordingly, the user caneasily carry out a desired edit, and the optimal image may be providedto the user.

Furthermore, with respect to the contents data 21 (normal image)recorded on the recording medium 11, a plurality of parameter sets(processing data 32) may exist. Accordingly, the user may performvarious edit operations to generate various parameter sets, so thatvarious image contents corresponding to the respective parameter setscan be made.

Here, the description is further made when the edit specified by theuser in the edit mode is tracking zoom. As described above, the user canperform an edit of enlarging a part of the normal image as the edit.Firstly, the enlargement will be described with reference to FIGS. 6A to6C.

FIG. 6A shows an example of the image displayed on the display apparatus13. The image shown in FIG. 6A is an image in which a house and peopleare displayed. When such an image is displayed, the user wishes to seefaces in details and enlarges the images of faces. When enlargement ofthe predetermined image is commanded, a range of the image to beenlarged is set by the user.

FIG. 6B shows a situation where an image frame 71 to be enlarged is setto the face portions in images by the user. In the case of the exampleas shown in FIG. 6B, the image frame 71 is set to the face portions inimages. When the image frame 71 is thus set, only the image within therange where the image frame 71 is set is displayed on the displayapparatus 13. In other words, in this case, even when the normal imageas shown in FIG. 6B is displayed on the display apparatus 13, the imagesof faces are displayed on the display apparatus 13 as shown in FIG. 6C,because the enlargement is commanded.

Tracking zoom function is provided so that the user may be free fromperforming operation with respect to such enlargement per each frame,and generation of the reproducing parameter 30 per each frame may beprevented. The tracking zoom is described with reference to FIGS. 7A to7E.

The tracking zoom is an assist function when the user uses a zoomfunction. This assist function is a function in which the user operatesthe operation unit 55 to focus and specify a tracking point on a targetto be zoomed, and while carrying out a process of tracking the target(while carrying out a process of tracking), zoom processing iscontinued. Some applications for processing the tracking zoom arearranged such that a zoom image frame can be changed during the trackingzoom or the tracking point can be changed.

FIG. 7A shows an example of the image displayed on the display apparatus13. The image shown in FIG. 7A is an image in which the house and peopleare displayed. When such an image is displayed, the user wishes to lookat faces more in detail, and thus it is set such that images of people'sfaces are zoomed up and people's faces are constantly displayed inenlarged state. In other words, in this case, the tracking zoom is setto people's faces.

In the case the image is commanded to be displayed by being trackedwhile the predetermined image is enlarged, a center and a range of theimage to be enlarged are set by the user. FIG. 7B shows a situationwhere an image frame 81 for zooming is set to the people's face portionin the image by the user. This image frame 81 may be set to be apredetermined size with a center thereof is a tracking point 82, or thesize may be set by the user.

In the case of the example shown in FIG. 7B, the tracking point 82 isset to the image portion of the people's faces, and the image frame 81is set so as to include whole portions of people's faces. When thetracking point 82 and the image frame 81 are thus set, the displayapparatus 13 displays only the image within the range to which the imageframe 81 is set. At this time, the tracking point becomes the center ofscreen and zoomed up in accordance with the zoom image frame (zoomrate). In other words, as shown in FIG. 7C, in this case, the image ofthe people's faces are displayed on the display apparatus 13.

Furthermore, when people in this screen moves, they are tracked whilethe enlarged state is maintained, accordingly an image, as shown in FIG.7D, is displayed on the display apparatus 13, for example. ComparingFIG. 7C with FIG. 7D, a part of the house which is not displayed in FIG.7C is shown in FIG. 7D. The image shown in FIG. 7D is an image when theimage shown in FIG. 7E which is displayed on the display apparatus 13,when the tracking zoom is not set.

FIG. 7E is illustrated for explanation and is not the image to beprovided for the user as long as the user does not specify in thepractical processings. In the image, the tracking point and the zoomimage frame are displayed in an input image during the tracking zoom. Inthe image in FIG. 7E, the man is moving towards the bottom left in thefigure with respect to the image of FIG. 7B. When the target to betracked moves, the tracking zoom processing is performed while following(tracking) the target, whereby the user is provided with the image asshown in FIG. 7D.

Therefore, while the tracking zoom processing is performed, an image canbe obtained as if the camera is moved and tracks the target when theimage is taken.

In this manner, when an edit referred to as tracking zoom is specifiedin step S30, the editing parameter (reproducing parameter 30) isgenerated which includes either one or both of the information on aposition within the normal image of the image tracked in the trackingzoom process (for example, information on coordinates where the trackingpoint 82 is located) and the information on the size (for example,information on the image frame 81) in step S31.

The reproducing parameter 30 continues to be generated by repeating theprocessing of step S30 and step S31 until the tracking zoom is stopped.In other words, the user may only set the tracking zoom once and thereproducing parameter 30 continues to be generated.

The thus generated reproducing parameter 30 and the contents data 21 ofthe normal image are reproduced, so that the user can view the editednormal image which is tracked and zoomed. In other words, the imagespecified by the user is extracted from the normal image, and the useris provided with the enlarged image.

Further, the description is continued with reference to the case wherethe tracking zoom is specified as the edit. For example, the descriptionis continued with reference to the case where the content data 21 arereproduced so that the normal image is displayed on the displayapparatus 13 as shown in FIG. 8.

A person 101 and a person 102 are displayed on the normal image shown inFIG. 8. If the user wishes to perform the tracking zoom against theperson 101, an image frame 121 is set to surround the person 101 asshown in FIG. 9 (hereinafter description is made by omitting setting oftracking point). An aspect ratio of this image frame 121 is the same asan aspect ratio of the image frame of the display apparatus 13. When thetracking zoom process is performed by this image frame 121, the user isprovided with the image in which only the person 101 is enlarged anddisplayed, as shown in FIG. 10.

In the case the user wishes to perform the tracking zoom to the person102, an image frame 122 is set to surround the person 102 as shown inFIG. 11. As a result, by performing the tracking zoom process, the useris provided with the image in which only the person 102 is enlarged anddisplayed, as shown in FIG. 12.

In this way, for example, with respect to the normal image in which theperson 101 and the person 102 are displayed, it is possible to performthe tracking zoom process separately for the person 101 and the person102. In such a case, the edit is performed separately, and separateprocessing data 32 are generated and stored.

With reference to FIG. 13, the parameter generated in this way when twoedits are performed to one normal image is described. A file 151includes reproducing parameters 160-1 to 160-N. A processing datum 171-1and a processing datum 172-1 are associated with a synchronizing feature161-1 and the data are included in the reproducing parameter 160-1.Similarly, a processing datum 171-2 and a processing datum 172-2 areassociated with a synchronizing feature 161-2, and the data are includedin the reproducing parameter 160-2. Similarly, a processing datum 171-3and a processing datum 172-3 are associated with a synchronizing feature161-3, and the data are included in the reproducing parameter 160-3.Similarly, a processing datum 171-N and a processing datum 172-N areassociated with a synchronizing feature 161-N, and the data are includedin the reproducing parameter 160-N.

Among the processing datum 171-1 and the processing datum 172-1associated with the reproducing parameter 160-1, the processing datum171-1 is a datum generated when the edit of tracking zoom is performedon the person 101, and the processing datum 172-1 is a datum generatedwhen the edit of tracking zoom is performed on the person 102. Thus,when two edits are performed on one frame, two processing data 171 and172 are associated with one synchronizing feature 161.

For example, when the image (frame) as shown in FIG. 8 is edited basedon the processing datum 171-1, the image in which the person 101 shownin FIG. 10 is enlarged is displayed on the display apparatus 13. Whenthe edit based on the processing datum 172-1 is performed, the image inwhich the person 102 is enlarged as shown in FIG. 12 is displayed on thedisplay apparatus 13.

The image based on the contents data 21 is constituted of a plurality offrames. For example, if an image is constituted by N frames, Nreproducing parameters 160-1 to 160-N are included in the file 151corresponding to the contents data 21 as shown in FIG. 13.

Thus, when there are two processing datum 171 and processing datum 172,it is also possible to reproduce them respectively or separately asdescribed above. When the data are reproduced separately, process issimilar to the one relating to reproduction where one processing datumis associated with one synchronizing feature. The process with respectto the reproduction when one processing datum is associated with onesynchronizing feature is carried out as described above, and thus thedescription thereof is omitted.

Next, the process when two processing data are related with onesynchronizing feature, in other words, when the file 151 as shown inFIG. 13 is reproduced together with the contents data 21 is described.Firstly, here, the image displayed on the display apparatus 13 when twoprocessing data are simultaneously processed is described with referenceto FIGS. 14 to 19.

FIG. 14 shows a state when the user side is provided with the image asshown in FIG. 8, and is a view apparently illustrating a situation wherethe image frame 121 is set to the person 101 as shown in FIG. 9, and asituation where the image frame 122 is set to the person 102 as shown inFIG. 11, on the same image.

As described above, the processing data 171 of FIG. 13 are datagenerated when the tracking zoom is carried out by means of the imageframe 121 set to the person 101, and the processing data 172 of FIG. 13are data generated when the tracking zoom is carried out by means of theimage frame 122 set to the person 102. In other words, when theprocessing data 171 and the processing data 172 are simultaneouslyreproduced, the user is provided with the image in which the trackingzoom by means of the image frame 121 set to the person 101 and thetracking zoom by means of the image frame 122 set to the person 102 aresimultaneously performed as shown in FIG. 14.

Here, when the user is provided with the image in which two trackingzooms are simultaneously performed, in other words, when two imageframes are set and the tracking zooms are performed by the two imageframes, the description is made by assuming that the tracking zoom isperformed by a new image frame generated by adding two image frames.

In this case, as shown in FIG. 15, an image frame 201 including theimage frame 121 and the image frame 122 is newly set, and the user isprovided with the result from the tracking zoom in this image frame 201.The image frame 201 is a size of an image frame in which the person 101and the person 102 are included. When the tracking zoom process isperformed by the image frame 201 as described above, the user isprovided with an image as shown in FIG. 16. As shown in FIG. 16, theuser is provided with an image which is enlarged one within the imageframe 201 as shown in FIG. 15.

Further, for example, as shown in FIG. 17, if the person 101 approachesthe person 102 in an image, in other words, if the image frame 121 andthe image frame 122 are overlapped, the image frame 201 as shown in FIG.18 is generated, the image within the image frame 201 is enlarged anddisplayed, and the image as shown in FIG. 19 is displayed on the displayapparatus 13.

In the case of the tracking zoom, and in the case where two processingdata are reproduced simultaneously, the tracking zoom process isperformed by the image frame of the size including the image framesrespectively in two processing data. Therefore, the image frame isvariably set to each frame. Further, although the description is madehere by exemplifying two processing data (two image frames) reproducedsimultaneously, the present invention may be applicable by performingthe similar processing even if a plurality of processing data aresimultaneously reproduced.

Thus, with reference to a flow chart of FIG. 20, the processing of thereproduction apparatus 12 when a plurality of processing data aresimultaneously reproduced and when the apparatus is in the reproductionmode, is described.

In step S61, the reproducing parameter processing unit 54 selects, fromthe file memory unit 58, a file used for reproducing the contents data21 recorded on the recording medium 11. In this case, it is assumed thatthe file 151 as shown in FIG. 13 is stored in the file memory unit 58.

The user operates the operation unit 55 based on the list of the filenames displayed on the display apparatus 13, thereby selecting one filename from the list of file names. Then, in step S61, the reproducingparameter processing unit 54 selects the file 151 specified by the filename as the file 151 used for reproducing the image.

In step S62, the reproducing parameter processing unit 54 reads thereproducing parameter 160 included in the file 151 stored in the filememory unit 58. The reproducing parameter processing unit 54 determineswhether the reproducing parameter 160 including a plurality ofprocessing data among the read reproducing parameters 160 exists. In thecase of the file 151 as shown in FIG. 13, for example, the reproducingparameter 160-1 includes the processing datum 171-1 and the processingdatum 172-2, and therefore it is determined in step S62 that a pluralityof processing data are included (plurality of processing data arerelevant with one synchronizing feature 161).

For example, as shown in FIG. 2, only the processing datum 32-1 amongthe reproducing parameters included in the file 22 is included in thereproducing parameter 30-1. While, the processing datum 32-2 and theprocessing datum 32-3 may be included in the reproducing parameter 30-2.Since the reproducing parameter is generated per each frame, and sincethe parameter is generated only for the edited frame, it is possiblethat the reproducing parameter 30-1 including one processing datum 32-1,and the reproducing parameter 30-2 including two processing datum 32-2and 32-3 exist in one file 22 as shown in FIG. 2.

Therefore, when performing the processing of step S62, the reproducingparameter processing unit 54 does not determine only by referring to thetop reproducing parameter 160, but determine with reference to theplurality of reproducing parameters 160. Alternatively, thedetermination in step S62 may be performed by providing the file 151with a flag indicative of whether a file includes a plurality ofprocessing data and referring to the flag.

In step S62, if it is determined that the plurality of processing dataare not related with one synchronizing feature, the process moves tostep S63. In this case, since it is determined that only one processingdatum is associated with one synchronizing feature, the case is similarwith the processing in the reproduction mode which is described withreference to the flow chart of FIG. 5 (steps S22 to S26), thus thedescription thereof is omitted here.

In step S62, if it is determined that the plurality of processing dataare related with one synchronizing feature, the process advances to stepS67. The processing data are selected in step S67. This selection of theprocessing data can be carried out by way of a similar process at stepS61 in which the file is selected, for example.

In step S67, when the processing data are selected, the process moves tostep S68. It is determined in step S68 whether sum of the selectedprocessing data is commanded. When the sum the selected processing datais commanded, it means that the plurality of processing data areselected by the processing of step S67. When the sum of the selectedprocessing data is not commanded, it means that one processing datum isselected by the processing of step S67.

In step S68, if it is determined that the sum of the processing data isnot commanded, in other words, when it is determined that one processingdatum is selected, the process advances to step S63, and the subsequentprocessing is performed.

On the other hand, in step S68, if it is determined that the sum of theprocessing data is commanded, the process moves to step S69. In stepS69, the reproduction of the normal image and the reproducing parameteris started. In other words, the reproduction of the contents data 21recorded on the recording medium 11 and the file 151 stored in the filememory unit 58 are started. Thus, the contents data 21 are reproduced(read) from the recording medium 11, the contents data 21 are suppliedto the image extraction unit 52, and the file 151 (reproducing parameter160 included in file 151) is supplied from the file memory unit 58 tothe reproducing parameter processing unit 54.

Here, as described above, the reproducing parameter 30 may exist pereach frame. The reproduction of the normal image is started with theearliest (in terms of time) frame where the reproducing parameter 160exists, unless particularly specified.

The reproducing parameter processing unit 54 starts reproduction of thereproducing parameter 160 included in the file 151. Thus, thereproducing parameter 160 starts to be supplied from the record andreproduction unit 51. Further, the reproducing parameter processing unit54 supplies the processing data operation unit 57 with the processingdata 171 and the processing data 172 which are included in the readreproducing parameter 160.

In step S70, the processing data operation unit 57 calculates a size ofthe image frame by using the processing data 171 and the processing data172. In other words, for example, the image frame 201 of FIG. 15 is set.In the example as described with reference to FIG. 15, the image frame201 is set as the image frame including the image frame 121 and theimage frame 122 (FIG. 14).

It is possible to find the position and size of the image frame 201 byextracting the endmost coordinates (four in total) from the coordinates(eight in total) at the respective vertices (corners) of the image frame121 and the image frame 122, for example. The data regarding thecoordinates are included in the processing data 171 or the processingdata 172.

When the image frame is set, the size (aspect ratio) of the image frameof the display apparatus 13 is taken into consideration.

In step S70, when the image frame is set, an image is extracted from thenormal image with the image frame in step S71. The normal image issupplied from the record and reproduction unit 51 to the imageextraction unit 52 per a frame basis, for example. By assuming the frameof the normal image supplied from the record and reproduction unit 51 tobe a frame of interest, the image extraction unit 52 sequentiallyextracts the extraction image from the frame of interest with a size ofthe image frame which is calculated in the processing data calculationunit 57 and supplied through the reproducing parameter processing unit54, and supplies the image to the signal processing unit 53.

In step S72, the signal processing unit 53 starts the signal processingbased on the reproducing parameter (correspondence parameter) suppliedfrom the reproducing parameter processing unit 54, with respect to theextraction image (frame) supplied from the image extraction unit 52.

In step S73, the reproducing parameter processing unit 54 determineswhether the operation unit 55 is operated by the user such that thereproduction is stopped (stop operation). In step S73, if it isdetermined that the stop operation is not performed, the process returnsto step S69. Hereafter, by repeating the similar processing, the user isprovided with an edit result when a plurality of edits are combined.

In step S73, if it is determined that the stop operation is performed,the process advances to step S74, and the reproducing parameterprocessing unit 54 controls the record and reproduction unit 51, theimage extraction unit 52, the signal processing unit 53, and theprocessing data operation unit 57, to stop the processes of reproducingthe reproducing parameter, extracting the extraction image, processingthe signal with respect to the extraction image, summing the processingdata (calculating image frame), and the like.

Except that the data of the image frame are the data calculated in theprocessing data operation unit 57, the processes in steps S71 to S73 arebasically similar with the processes in steps S64 to S66.

In step S75, the reproducing parameter processing unit 54 determineswhether the parameter set which is a set of the reproducing parametersstored in the reproducing parameter memory unit 56 is to be newly stored(saved) in the file memory unit 58. In this case, the parameter set isthe result from calculation by the processing data operation unit 57,and is a combination of the results of the plurality of edits.

In other words, by controlling the signal processing unit 53, thereproducing parameter processing unit 54 causes the display apparatus 13to display an inquiry message asking whether the new parameter setshould be saved. Upon waiting that the user operates the operation unit55 with respect to the inquiry messages, whether the new parameter setstored in the reproducing parameter memory unit 56 is stored in the filememory unit 58 is determined.

In step S75, if it is determined that the new parameter set stored inthe reproducing parameter memory unit 56 is stored in the file memoryunit 58, in other words, if the user operates the operation unit 55 withrespect to the inquiry message so that the new parameter set may bestored, the process moves to step S76. The reproducing parameterprocessing unit 54 reads the new parameter set stored in the reproducingparameter memory unit 56, and stores the new parameter set in the filememory unit 58.

Further, in step S75, if it is determined that the new parameter setstored in the reproducing parameter memory unit 56 is not stored in thefile memory unit 58, in other words, if the user operates the operationunit 55 with respect to the inquiry message so that the new parameterset may not be stored, step S76 is skipped and the process advances tostep S77. The reproducing parameter processing unit 54 deletes(eliminates) the new parameter set stored in the reproducing parametermemory unit 56, the process returns to step S61, and the similarprocessing is repeated hereafter.

As described above, since the extraction image is extracted from thenormal image with the image frame based on two processing data, the usercan easily confirm results tracking zoom processes separately performedare combined. In other words, when the plurality of edits separatelyperformed are combined, it becomes possible to easily confirm how theedit will be resulted.

In the embodiment, the example is described in the case where thetracking zoom is carried out at another image frame by summing theplurality of processing data when subjected to the edit which isreferred to as the tracking zoom. Next, an example will be described inthe case where the tracking zoom carried out at another image frame bysubtracting the plurality of processing data when subjected to the editwhich is referred to as the tracking zoom.

FIG. 21 shows a situation where the image frame 201 and the image frame202 are set in the image in which the person 101 and the person 102 aredisplayed and the tracking zoom process is performed in respective imageframe, and apparently shows on one screen a situation where the twoimage frames are set. As the tracking zoom is performed by means of theimage frame 201, the processing data are generated. As the tracking zoomis performed by means of the image frame 202, the processing data aregenerated. Here, the description is continued by assuming that theprocessing data generated as a result of performing the tracking zoom atthe image frame 201 are the processing data 171 (FIG. 13) and theprocessing data generated as a result of performing the tracking zoom atthe image frame 202 are the processing data 172 (FIG. 13).

When a positional relation between the person 101 and the person 102shown in FIG. 21 becomes as one shown in FIG. 22, in other words, whenthe person 101 is not moving and the person 102 approaches the person101, the image frame 201 and image frame 202 may overlap. As such, whenit is set up as an image within one image frame is displayed by theuser, and an image within the other image frame is not displayed, theimage frame as shown in FIG. 23 is generated and the processing of thetracking zoom in the image frame is performed.

Here, it is set as the person 101 within the image frame 201 isdisplayed and the person 102 within the image frame 202 is notdisplayed. If the image frame 202 overlaps the image frame 201 undersuch a setup, an image frame 221 is set from the image frame 201 withthe image frame 202 excluded. That is, the image frame 221 which issmaller than the image frame 201, but does not include the image frame202, is set. In other words, the image frame in which the image frame202 is subtracted from the image frame 201 is set as the new image frame221. Further, since a new aspect ratio of the new image frame 221 needsto be the same aspect ratio of the image frame of the display apparatus13, as similar with other image frames, the image frame in which a partof the person 101 is displayed as shown in FIG. 23 may be set.

Thus, in such a setup, when the processing data 171 regarding the person101 and the processing data 172 regarding the person 102 aresimultaneously reproduced, only the person 101 is displayed on thedisplay apparatus 13. Even if the person 102 approaches the person 101as shown in FIG. 22, the display is performed such that the image frameis changed such that the person 102 is not displayed. Consequently, onlythe person 101 is displayed on the display apparatus 13. Thus, byemploying the present invention, it becomes possible to display only afavorite image out of a plurality of images.

Next, the processing with respect to such subtraction of the processingdata is described. The processing when displaying the image based ondesired processing data among the plurality of processing data, and notdisplaying the image based on other processing data, is carried outbased on a flow chart as shown in FIG. 24.

The processing of the flow chart shown in FIG. 24 is basically similarwith the processing of the flow chart shown in FIG. 20. In other words,when reproducing the plurality of processing data, the subtractionprocess is carried out, basically as similar with the processing whenperforming the summing process. Here, only the processing different fromthat in the flow chart as shown in FIG. 20 is described.

In performing the subtraction process when reproducing the plurality ofprocessing data, it is determined in step S108 whether subtraction ofthe processing data is commanded. The user selects the image to bedisplayed and the image not to be displayed from the plurality ofprocessing data. The processing data are chosen in accordance with theselection. Even if the user only selects the image to be displayed, inother words, even if an image not to be displayed is not selected, theunselected image may be set up as the image not to be displayed.

In the case of the example shown in FIG. 23, the image to be displayedis the person 101 in the image frame 201. As a result of the processingof the tracking zoom by means of the image frame 201, the generatedprocessing data are the processing data 171 (FIG. 13). Therefore, theuser selects the processing data 171 as the processing datacorresponding to the image to be displayed. Further, in the case of theexample as shown in FIG. 23, the image to be deleted is the person 102in the image frame 202. As a result of the processing of the trackingzoom by means of the image frame 202, the generated processing data arethe processing data 172 (FIG. 13). Therefore, the user selects theprocessing data 172 as the processing data corresponding to the image tobe displayed.

In step S108, if it is determined that the subtraction of the processingdata is commanded by the user, the process advances to step S109. Instep S109, the contents data 21 are read from the recording medium 11,and the reproducing parameter 160 are read from the file memory unit 58.The size of the image frame is calculated in step S110. Calculation ofthe size of the image frame at step S110 is performed by subtracting theprocessing data set as the image not to be displayed from the processingdata set as the image to be displayed by the user.

In this case, the calculation is carried out by means of the processingdata 171 and the processing data 172 which are included in the readreproducing parameter 160. As described above with reference to FIG. 23,when the image frame 201 is set to the image frame which does notinclude the image frame 202, the data regarding the image frame 201included in the processing data 171 and the data regarding the imageframe 202 included in the processing data 172 are used to set the imageframe 221.

In step S110, when the size of the image frame is calculated, it isdetermined whether a part of the image set by the user to be displayedat the set-up image frame is deleted in step S111. For example, againwith reference to FIG. 23, when the image frame 202 overlaps with theperson 101, the image within the image frame 202 is set so as not to bedisplayed. Therefore, a part or whole part of the person 101 that is setup to be displayed may not be displayed.

It is also possible to set such that a part of the image intended to bedisplayed may not be displayed. In such a setup, it is possible to omitthe processing of step S111. However, if it is set to a situation wherenon-display of a part of the image intended to be displayed is notallowed, in other words, a situation where image intended to bedisplayed is wholly displayed, it is determined in step S111 whether thesize of the image frame causes even a part of the image set up to bedisplayed to a non-displayed state.

In step S111, if it is determined that a part of the image is deleted,the process returns to step S110 and the size of the image frame iscalculated again. At this time, the size of the image frame fordisplaying the whole parts of image that is commanded to be displayed iscalculated. The processing of step S111 is performed for the image frameset again. In step S111, if it is determined that the image frame doesnot cause a part of the image to be deleted, the process advances tostep S112.

It should be noted that, the image frame is set by taking intoconsideration of the size (aspect ratio) of the image frame of thedisplay apparatus 13.

Since the processing in step S112 and steps subsequent thereto issimilar to the processing in step S71 in the flow chart of FIG. 20, thedescription thereof is omitted here.

As described above, since the extraction image is extracted from thenormal image by the image frame based on two processing data, the usercan easily confirm results when the tracking zoom processes separatelyperformed are combined. In other words, when the plurality of editsseparately performed are combined, it becomes possible to easily confirmhow edits will be resulted.

Thus, according to embodiments of the present invention, it is possibleto perform the plurality of edits separately, and to easily combine theplurality of edits which are performed separately. Therefore, the usercan easily obtain the image subjected to the new edit from the pluralityof edits which are separately performed.

[Recording Medium]

A series of processings described above may be performed by hardware,and may also be performed by software. When a series of processings areperformed by software, programs which constitute the software areinstalled from a program recording medium to a computer built indedicated hardware or in a general-purpose personal computer, or thelike, for example, which can carry out various types of functions byinstalling various types of programs.

FIG. 25 is a block diagram showing an example of a structure of hardwareof a personal computer which performs the series of processings asdescribed above by a program.

In the computer, CPU (Central Processing Unit) 301, ROM (Read OnlyMemory) 302, and RAM (Random Access Memory) 303 are mutually connectedby a bus 304.

An input/output interface 305 is further connected to the bus 304. Theinput/output interface 305 is connected to an input unit 306 constitutedby a keyboard, a mouse, a microphone, and the like, an output unit 307constituted by a display, a speaker, and the like, a memory unit 308constituted by a hard disk, a non-volatile memory, and the like, acommunications unit 309 constituted by a network interface, or the like,and a drive 310 for driving removable media 311, such as a magneticdisk, an optical disc, a magneto-optical disc, or a semiconductormemory, and the like.

In the thus configured computer, CPU 301 loads the program stored in thememory unit 308 to RAM 303, via the input/output interface 305 and thebus 304, for execution of programs.

The programs to be executed by the computer (CPU 301) is recorded on theremovable media 311 which are package media constituted by a magneticdisk (including flexible disk), optical discs (CD-ROM (Compact Disc-ReadOnly Memory), DVD (Digital Versatile Disc), etc.), a magneto-opticaldisc, a semiconductor memory, or is provided through wired or wirelesstransmission media, such as a local area network, the internet, anddigital satellite broadcasting.

Further, by mounting the removable media 311 to the drive 310, theprogram can be installed in the memory unit 308 via the input/outputinterface 305. Furthermore, the program can be received at thecommunications unit 309 through the wired or wireless transmissionmedia, and can be installed in the memory unit 308. In addition, theprogram can be preinstalled in ROM 302 or the memory unit 308.

It should be noted that the program to be executed by the computer maybe a program with which the processings are performed along the order ofthe description in the present specification, and may be a program withwhich the processings are performed at a timing when the processings arerequired, such as when it is called.

Further, in the present specification, “system” represents the wholeapparatus constituted by a plurality of apparatuses.

It should be noted that embodiments of the present invention are notlimited to the embodiments described above, and various modificationsare allowed without departing from the gist of the present invention.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

The present document contains subject matter related to Japanese PatentApplication No. 2007-155938 filed in the Japanese Patent Office on Jun.13, 2007, the entire content of which being incorporated herein byreference.

1. An information processing apparatus, comprising: reproduction controlmeans for controlling reproduction of a first parameter in order toreproduce an edit applied to a first image; generation means forgenerating a second parameter from a plurality of first parametersreproduced by the reproduction control means; and edit means for editingthe first image based on the second parameter generated by thegeneration means, and generating a second image.
 2. The informationprocessing apparatus according to claim 1, wherein; the first parameterincludes at least a parameter for extracting a predetermined area fromthe first image, and the second parameter is a parameter for extractingan area including a plurality of areas based on the plurality of firstparameters from the first image.
 3. The information processing apparatusaccording to claim 1, wherein; the first parameter includes at least aparameter for extracting a predetermined area from the first image, andthe second parameter is a parameter for extracting, from the firstimage, an area for extracting an image in a predetermined area among aplurality of areas based on the plurality of first parameters, and notextracting an image in other areas.
 4. The information processingapparatus according to claim 1, wherein; the generation means generatesthe second parameter by adding the plurality of first parameters, orgenerates the second parameter by subtracting other parameters from apredetermined parameter among the plurality of first parameters.
 5. Aninformation processing method, comprising the steps of: controllingreproduction of a first parameter for reproducing an edit applied to afirst image, generating a second parameter from a plurality of firstreproduced parameters, and editing the first image based on thegenerated second parameter, to generate a second image.
 6. A program forcausing a computer to perform processes including the steps of:controlling reproduction of a first parameter for recreating an editapplied to a first image, generating a second parameter from a pluralityof first reproduced parameters, and editing the first image based on thegenerated second parameter, to generate a second image.
 7. A recordingmedium recorded therein a program for causing a computer to executeprocesses including the steps of: controlling reproduction of a firstparameter for recreating an edit for a first image, generating a secondparameter from a plurality of first reproduced parameters, and editingthe first image based on the generated second parameter, to generate asecond image.